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DETAILED ACTION 

Information Disclosure Statement 

4l. ; : . ; Pe.WtoBfflioB disclosure statement (©% filed on 01/1102002, has t^nlaced in iltev 
^icanWfile, and die information refcrreS to ttwawfatos beeaconikfe^ 

Claim Objections 

2. Cto 13 Is ejected to because of the following informalities: in claim 13, the limitation i 
^beginning with lettering "(c)'* should be "<b) w . Apfaopriate correction is required. 



Claim Rations -3SUSC§ 102 



3* : • Thelbllowfag is -a quoiacion of the apprc^riatevpiimgmphs of 35 tf J5.& 102 that form tlie 



- ? ;> | 4Mik m&U m^^mtc tim wm-ye& psfat 4m btt^imim for pilcfii k the United Sm^ •• 



Claims 1^,8, 10, 



-ant ieipted - by Caif son (U S. Pal, #4,554,585)* 

"3fe^fi». l s Cadsoo teaches an electronic imaging system (fig. 1, 100, llOj IflJ^Jor^ 



1^. 



ctptoriiig an image of a scene (col 2, lines 57-62), said imaging system comprising: 



llllp. '(a^ap bpdcaj system (tig, 1 , 100) for produci^^ 



•: y- 



<b> an imaging sensor (solid-state imager, col. % lines 63-65) having a surface in optica! 
commumcation (col % line 66 ~ col. 3, line 2} with the oj»tical system; and 




sensor (co! 4* &c$ 13*23) for converliiig th& optical image into a corresponding output signal 
j^-^litiet 4-1), laid imaging elcm«iits iocaied a^ordiiii to a distribution ^pi^seriAle by a - 
in which the relMiwdensiiy of the: dffis^l^ ••■ . , ■-■}^:. •. ; \ ^ 




mm* 



--- -- ■ : ^f' '^4 



■ .-> ' ...v .. -.• : " 



For cfaim .2. Carison tether discloses a system wherem the nop^laiiar sorfece is 
inherently a cylinder. This is inherent because in col. 4, lines 28-33* j(^k^ r ^|^^ the 
' ; dt$ef€t& picture elements 200 are symmetrically disposed about the center of a poiar^€b0rdiiial€ iHR-i;.'--^^ 



! ■ . • ••; • : . ■ . ■ <■ 



For dbun-3» Carlson further discloses a^^-y^mmn the non-planar surface 
Jpf^r -This;is ^.iIlhe^:'bccal^-in- cot. 4 f lines 2^33v : CarIsoii state* that ire. discrete, picture 



}i ■ • My 



i cente cCa f3^liw»Krdifiaie spatial 



For claim 4, Carlson funhcr discloses an optical syst6n thai includes a lens (fig. 3, 304) 
% <Wd,iie-a3tii of rotaicm of the cylinder intersects a nodal point of the lens, • As stated before, 



fiaje^tktCartOT'siraij!^ 4, lines. 28-33, Cirison, 



states tlmt ihe discrete picture elements 200 are symmeuieally disposed aboutdiecenterofa 

is 




Asiliiistymed m fig; 1 3*;'ih'e: center of -the. cyliiki%; is! 



•tife imag^ is located along the optfoJ axfe oftibelens 
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(col. 5, lines 13-19). The imager senses light from the lens via a low-pass filter (col. 5, lines 26- 
29). 

For claim 5, Carlson further discloses a system wherein the optical system includes a lens 
and the center of the sphere is located at a nodal point of the lens. As stated before, it is inherent 
^tii^t Carlson's non-planar surface is a sphere because in col. 4(jin$s 28 '^W^ta^^^i^jim^ 
ildiscrete^picture elements 200 are symmefrically disposed about the center of a polar-coor^ 
^^tiaidiistribution pattern. As illustrated in fig. 3, the center .of the sphere is located at a nodal * 
yoaAoS^is lens .because the imager is located along the optical axis of Hie lens (coL 5-, ltoe$:'13- - I * ; 

: 4-9);: The imager senses light from the lens via a low-pass .filter (col. '5, lines, 26-29); ^ ^ 

For claim 8, Carlson further discloses a system wherein the imaging sensor is a charge- t 
coupled device (col. 2, lines 63-65). vv.,; [ : /;./■,■ > > ' S v 

For claim 10, Carlson iiulher discloses a system wherein the output signal includes data 
from a plurality of images (coL 2, lines 19-33). 

For claim 13, Carbon teaches an electronic image sensor (solid-state imager, col, 2, lines 
63-65) for use in an electronic imaging system (fig. 1, 100, 11 % 108) for capturing an optical ; 



•;p^f ai scene (col. 2,:iines;57T62); said sensor cortprfeiiig^ v 



;:^;^a$tirfkce in Qpticalcbmmunication with the scene (col .2; line 63 - coL 3, line 10); '^W W m 
and . ' :: -'(: : y':^ 

(c) a plurality of imaging elements (fig. 2a) distributed on the surface of the sensor (col f 

: 4,im<$i y 

4-7), said imaging elements located on the surface according 10 a distribution represenlable by a 
nonlinear function in which die relative density of the distributed imaging elements is greater 
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toward the center of the sensor (col. 4, lines 28-33), wherein die distribution provides physical : ; Y$£k 

,.cponiuaates for each of the imaging elements corresponding to a projection of the.scene brito-a vV-.; 
non-planar surface, thereby compensating for perspective distortion of the scene onto the non- 
plaiiar surface (col, 4, lines 24-28), 



Regarding claim 14, this claim is a claim corresponding to jhe;claim2 > ^ 



» is analyzed and rejected as previously discussed /W&;-ms^t tb-'bluih 2. ; f , 

1 5 is analyzed and rejected as previously discussed with respect to claim 3. 00W'< 
Regarding claim 16, this claim is a claim corresponding to the claim 8. Therefore, claim ' ! i §j$ 



16 is analyzed and rejected as previously discussed wiUrrespect to claim 8. i ^v 1 ^ ' Ife, 



For claim 18, Carlson discloses a digital camera (fig. 1, 100, 1 1 0, 1 08) containing the ! ^ r f K ? 
i&^m fensor|^lid-state imager, col. 2, Uncs 63-6^^ 
signal processor of Carlson's camera digital. ; - v V ? • 

For claim 19, Carlson discloses in an electronic imaging system (fig, 1 , 100, 110, 108) ? ; U ' Wf; 
includmg ah image sensor (solid-state to % ^ ; ;. 

miage into an output signal (col. 3, lines 4-7), Uie improvement wherein the image sensof 



C comprises a pltimlity of imaging elements (fig. 2 a) distributed -on; a surface of the sensor (col. 3, 'i 
lines 4-7) lor converting the optical image into a corresponding output signal (col. 3, lines 4-7); 
said Imaging elements located on the surface according to a distribution rcpresentable by a 

' ■ 'y ■ 

nonlinear function in which the relative density of the distributed imaging elements is greater : ; " 1 

toward the center of the sensor (col. 4, lines 28-33), thereby compensating for perspective f:^ff ? * 

distortion of the scene onto a non-planar surface (col. 4, lines 24-28). . - ; 
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Regarding claim 20, this claim is a claim corresponding to the claim 8. Therefore, claim 
20 is analyzed and rejected as previously discussed with respect to claim 8. 

For claim 22, Carlson inherently discloses a system including the improvement wherein 
the. image sensor (solid-state imager, col. 2, lines 63-65) is a component in a digital camera (fig. 
1 , refs. 100, 1 1 0, 108). In col. 3, line 47, Carlson teaches that the image signal processor of the 
camera is digital, 

'_>■;.;■ " ;'H : Claim Rejections - 35 VSC § 103 ■ ■ -1 

:$;'■■; ■ %^ : appnc^mxatmiy n^esjbintiiivcntbrs,- In considering patentability <pf the ■■ ;■. 
claims under 35 U.S.C. 103(a), the examiner presumes that the subject matter of the various 
claims was commonly owned at the time any inventions covered diereiii were made absent any 
evidence to the contrary. Applicant is advised of the obligation Under 37 CFR 1.56 to point out 
me inventor and invention dates of each claim that was not commonly owned at the time a later ; 
jinygntio^^ in order for ;-dhae examiner to sonsito 
and^otent^ 

6. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

section 102 of this title, if the differences between the subject matter sought to be patented and the prior art arc 
such that die subject matter as a whole would have been obvious at the time die invention was made to a person " 
!? 8 ^' n 8P r ^' nai y skill in the an to which said subject matter pertains. ^Patentability shall not bencgatived by the 
. : manner in which the invention wis' made. 



7, Claims 6-7 are rejected under 35 U.S.C. 1 03(a) as being unpatentable over Carlson (U.S. 
Pat. #4,554,585) in view of Hsieh ct al. (U.S. Pat. #6,798,923). 



For claim 6, Carlson does not spccificaUy disclose a system wherein the mdius 
cylinder is a function of a focal length of the optical system* However, in col 4 lines 28*33, 
Carlson states that the discrete picture elements 200 are synraietrically disposed about the center 
ofap<^ 

; ^^^^^^^^^ ^ 

The cenler of the cyiiiidWcal images wlii^ 
low-pass filter (coL 5* lines 26-29), is located along the optical axis of the lens as illustrated in 
? ^''^ Q^^.C^^^JiiM^" 13-19}* In the same field of endeiwor>Hsieh explains to 
: f^> : ^ projected cm a cylinder (a>L 3 y 'Vim^^^Si^^Wj^: ;v;k 

focal length will change with itspeci u> .thc^iwliiis* 11ewtfoie.il would have been obvious to one 
of ordinary skill in the art at Uhe lime the invention was made for Carlson to implement a system 
4 wh&re$n the radius of the cylinder is a {unction of a focal length of the optical system hi order to 

sphere is a function of a focal length of the optical system. However, ui col 4 lines 28*33, 
Carlson states that the discrete picture elements 200 are symmetrically disposed about the center 
^ ^ Additionally, in figure 2a, Carlson illustrates an 

image sensor where the rwiim changes with respect to tlw higMow resoiuUon periplnay 
lines 24-42). The center of ihe spherical imager, which senses light from the Jens via a tow-pass 
filter (col. 5, lines 26-29), is located along the optical axis of the lens as illustrated in fig. 3 (col. 
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iS, lines 13«19) ; In 1iie same field of ^ - s 



a?v$?r Y 



panoramic distortion of images projected on a sphere (col. 3 ? line 65 - col. 4, line 40). Although, 
Hsieh gives an example of the cylindrical geometry, Carlson utilises polar coordinates as Y : j I 



ej^laii^d iii claim 3. Since Hsieh states that the radius is equal to the focal length, the focal ^ ^ ! 



length wlCchattge w "Thereibi^ 
ordinary skill in the art at the lime the invention was made for Carlson to implement a system 
wherein the radius of the sphere is a fiinction of a focal length of the optical system in order to " %i 1 
permit a predetermined mapping of the image onto the sensor. < 

Carlson (U.S. Pat, #4,554,585) ~~ : " - V- ' ■ : YY' *' : 



: -v : ; For claim 9, Carlson does not specifically disclose a system wherein die imaging sensor M ; 

;%£„:■'■':. ' ^ : ' ■ ' • " - ' - ' 113 

flslafCMOS device; ribwever^ih coh 2 

includes a solid-state imager. Examiner takes Official Notice that it is vvell Imown in the art lor a 
CMOSdeyieetobe^a It would have been obvious to one of ordinary 

^sktll.-m.the art-at .the ttme;^ tnventtoii-was made for Carlson to pxovide a svs^Hvherein the 
imaging sensor is a CMOS dev^ 

; ; processing circuit to bej : ntegrated : oil ^s^e^bstmte^Y' ?X: '€ ' y ■';=':] ; " : ' l-Y" ; 

17 and 21, both of these claims are claims corresponding to the claim 
9, llterefore, claims 17 and 21 are.aiialyzed .and^rejecled' : as previously discussed with respect to 
Mmms§, v • • 7 . : ' • • ■ ; • < ,-v. ,■ • - \ ... :S :*.v\ ; . . • " 

V - „ . • ' - ^ • ' . • • Y '•• '"^ Y - ■ ' — • •• r - -"^ Y-. Y ' 

W ;-,.r ; -C!aiiiii4 : M2^ rejected u^er r 35JU^ 

Y'- : .' .;. •' '• . • . • . Y ""■ • ■ " : " •> ' . ... 4/ / - WM IS . j 

(U.S. Pat. #4,554,585) in view of Ribera ct al. (U.S. Pat, # 6,603.503), - v ' \ 



r? ;.v. rasa 
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For claim 11 , Carlson discloses a system with a moveable television camera that 
produces a video signal, which is coupled to an image signal processor. Carlsons image signal 
processor, which analyzes the image defined by the video signal to determine the exact 
whereabouts of a particular object in field of view, can inherently operate directly on the output 
signal witlibut having to warp the image data (coK 3 > lines 3346). However, Carlson does hot 
teach a system including a processor for combining the images into a composite image. 
^ x In the same field of endeavor, Ribera discloses a system including a processor (Ribera, 
fig. 4, rcf. 10) for combining the images into a composite image, thereby the processor can 
^operate directly on the output signal without having to warp the image data (Ribera, col. 6, lines 
;M&2 1 and coL 4 Jines 5 lr55). Similar to.Kibera, Carlsons invention is related' to widevieW ' 

^^son^coh '2, Jine 67 «~ col/3, line 1). Therefc^ 
ot^^ the time the invention was m#^ i% 

including a processor for combining the images into a composite image, thereby the processor 
can.operate directly on the output signal without having to warp the image data in order to 

:/d 

coi. 1, lines 36-39). -' ; -": 

P^.dp^l^CM^'d(mfidl'fiti^ disclose a system ii^tid^i^f^Btcw^r'.' 
projecting the composite image onto a planar surface. However, Ribera further discloses a 
system including a projector (Ribera, fig. 4, ref. 20) for projecting the composite image onto a 
planar surface (Ribera, col. 6» lines 10-21). Similar to Ribera, Carlson's invention is related ta 
panoramic/wide view images (Carlson, col. 2, line 67 - col. i, line 1). Therefore, it would have 
^b6en obvious to one of ordinary skill in the art at. the time ^ 
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impleraent a system iiicludiiiga i^ecior lbr projecting thecmtposite ima^oiiio a pter 
surface in order to display panoramic images over a substantially 360 degree by 360 degree 
range of angles (Ribera, col I, lines 36-39). 

10. Claims 23-27 are rejected under 35 U.S,C. 1 03(a) as being ui^temable over Carlson 
J$S$ J>at #4,554,585) in view of Huang et al. (^Pano^ with ; 

AiMmaaic Disparity Waiping and Seaming/* Graphical Models and image Processing, Vol, 60, 
No. 3, May 1998, pp. 196^208.) 

Forckim 23, Carlson teaches a method 
generating^^ 

d&buted so m to eomj^isate ^ j^is^i w distoti^ non-pl warsuriace 

(coi. 2 f lines 63-65; coL 3, lines 4-7 and 47; col. 4, lines 28-33), This claim differs from Carlson 
m that he does not teach a method of generating a composite digital image from at ieasttsw 
source digital images, said method comprising: 

^ * v f : ' 

image from at least two wurce digital images (page 197, section $'A. f paragraph 1% said method 
comprising: (b) combining the source digital images to form a composite digital image (page 
20Q*sec*iofi %$% Addilioimlty, 

imaging sensor because his system incMes two cameras for the left-eye and the ri^ep j^age 
197, section 3 A , paragraph 2); This system generates focused images by selecting the correctly 
Mm^ mm f&mk s^^t (p^es 197-198, Action 3 j 5 paragrapte 1-2). Please see jgs. 5-6 
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and read pages 199-200, section 3,4, paragraphs 1-2; Similar to Huang, Carlson discloses an 
Jm|ging system for image warping/ blurring improvements (Carlson r Abstract), It would have 
been obvious to one of ordinary skill in the art at the time the invention was made for Carlson to 
provide a method of generating a composite digital image from at least two source digital images 
in order to provide 360° panoramic stereo images (Huang, section 2, page 197, paragraphs 2-4). 

"'For claixri 24. Carlson, as modified by Huang, fiirther disclos^ 
pr^wtor for projecting the composite image onto k-:planar'i^ac^; ; On pages 204^0^ liuaiig 
C^cplains and illustrates the experimental results of the panoramic stereo imaging systeitt, He >' 
demonstrates how the image distortion correction of the composite image is projected onto a 
planar surface. It would have been obvious to one of ordinary skill in the art at the time the 
invention was made for Carison to provide a method 

;^inp6 stereo images (Huangj 

section 2, ^age 197, paragraphs M ^ 

For claim 25, Carlson does not teach a method wherein the two source digital images 
overlap in overlapping pixel regions. Huang teaches a method wherein the two source digital 
.'"Migfes .overtep-iri pverlapping..ptxei .regions (Huang, page 207* section 5 - Conclusipn). It i 
vvotd 

!>&>r ^ source digital images overlap in overlapping^ 

pixel regions in order to provide 360° panoramic stereo images (Huang, section 2, page 197, 
paragraphs 2-4), 

For claim 26, Carlson, as modified.by Huang, further discloses a method wherein the 
non-planar surface is a cylinder, in col. 4 lines 28-33, Carlson states that the discrete picture 
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elements 200 are symmetrically disposed about the center of a polar-coordinate spatial 
distribution pattern. It is wet! known in die ait for coordinates of a cylinder to be laiovm as polar- 
Aim, pfepss read Huang, pages 199*200, section 3.4 , paragraphs 1 -2- 
For duim 27, Carlson, as modified by, Huang further discloses a system wherein the 
non-planar surface is a sphere. In cot 4 lines 28-33, Carbon states that the discrete picture 
elements 200 are symmetrically disposed about the center of a polar-coordinate spatial 
distribution pattern. It is well known in the art for coordinates of a sphere to be known as polar- 
coordinates . In the diselo^^ ' 
imagmg system. Although he uses a cylindrical surface to describe Ms panoramic stereo 
imaging system, Huang makes readers aware of the need for image distortion correction for 
; ^images at the pi*opcr posi tions of a sphere as well m a cylinder. 

Cam^mn i, ■ ; : v : 

-11; Any inquiry concemtng this communication or Earlier eommtmu^to 
examiner should be directed to Carramah J. Quictt whose telephone number is (703) 305-0566. 
Has examiner can normally be cached on 8:00-5:00 WC\ BeRtnn>n^ Mai^ 2M5 v tfae 
;; exam^s^letaione mimber willMctoimM ia{S7IV272~731& ; ■ ,> : . 

Ifattempts to mach the examiner by telephoned exanuher r s 
^U|^i^ Wendy Garber can be reached on (703) 30$-4?2?; Beginning March 22. 20QS, the 
su0ervisor"s telephone number will be chanted to (5711 272-7308. The fax phone number for 
the organisation where this application or pnx^eding k assigned is 703-872^9306* 
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Information regarding the status oFan application may be obtained from the Patent 
vApphcation Information Retrieval (PAIR) system. Status information for published applications 
iiniay be pbtatnedirom either Private PAIR or Public PAm; Status 
Applications is available tlirough Private PAIR only. For. more information about thePAlR 
system, sec http://patr-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (loll-free). 



;CJ.Q: ,/. 
:March 7,i2005 
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